A through hole refers to a hole that is reamed, drilled, milled etc., completely through the substrate. In other words, a through hole is a hole that goes all the way through something. This is to distinguish it from a blind hole, which does not go all the way through the substrate.
Taps used for through holes are generally tapered since it will tap faster and the chips will be released when the tap exits the hole.